A Faster Algorithm for Learning Decision Trees With Module Nodes
نویسندگان
چکیده
One of the challenging problems regarding learning decision trees is whether decision trees over the domain Z~, in which each internal node is labeled by a module function axi(mod N) for some i E (1 .... ,n), are efficiently learnable with equivalence and membership queries [5]. Given any decision tree T, let s be the number of its leaf nodes. Let N = p~l...p~ be its prime decomposition, and let 7(N) = (tl 1)... (t~ + 1). We show that when all the module functions in T have the same coefficient, then there is a polynomial time algorithm for learning T using at most s(s + 1)7(N) equivalence queries and at most s2nT(N) membership queries. Our algorithm is substantially more efficient than the algorithm designed in [7] for learning such decision trees. When N is a prime, our algorithm implies the best-known algorithm in [4] for learning decision trees over a finite alphabet.
منابع مشابه
Fast and Accurate Decision Trees for Natural Language Processing Tasks
Decision trees have long been used in many machine-learning tasks; they have a clear structure that provides insight into the training data and are simple to conceptually understand and implement. We present an optimized tree-computation algorithm based on the original ID3 algorithm. We introduce a tree-pruning method that uses the development set to delete nodes from overfitted models, as well...
متن کاملA New Algorithm for Optimization of Fuzzy Decision Tree in Data Mining
Decision-tree algorithms provide one of the most popular methodologies for symbolic knowledge acquisition. The resulting knowledge, a symbolic decision tree along with a simple inference mechanism, has been praised for comprehensibility. The most comprehensible decision trees have been designed for perfect symbolic data. Classical crisp decision trees (DT) are widely applied to classification t...
متن کاملUtilizing Generalized Learning Automata for Finding Optimal Policies in MMDPs
Multi agent Markov decision processes (MMDPs), as the generalization of Markov decision processes to the multi agent case, have long been used for modeling multi agent system and are used as a suitable framework for Multi agent Reinforcement Learning. In this paper, a generalized learning automata based algorithm for finding optimal policies in MMDP is proposed. In the proposed algorithm, MMDP ...
متن کاملComparing different stopping criteria for fuzzy decision tree induction through IDFID3
Fuzzy Decision Tree (FDT) classifiers combine decision trees with approximate reasoning offered by fuzzy representation to deal with language and measurement uncertainties. When a FDT induction algorithm utilizes stopping criteria for early stopping of the tree's growth, threshold values of stopping criteria will control the number of nodes. Finding a proper threshold value for a stopping crite...
متن کاملDecision Tree Construction using Greedy Algorithms and Dynamic Programming – Comparative Study
The paper presents comparative study for different heuristics used by greedy algorithms for constructing of decision trees. We consider the problem of exact learning for decision tables with discrete attributes. We made experiments with randomly generated decision tables contain attributes with three categories {0,1,2}. Complexity of decision trees is estimated relative to several cost function...
متن کامل